18.05 Lecture 22 
April 4, 2005 



Central Limit Theorem 

Xi,...,Xn - independent, identically distributed (i.i.d.) 

/X = EX, cr2 = Var(X) 



\/n{x - ji) 



You can use the knowledge of the standard normal distribution to describe your data: 
This expands the law of large numbers: 

It tells you exactly how much the average value and expected vales should differ. 



= Vn-{ h ... H ) = —^{Zi + ... + Zn) 

where: Z^ = ^^;E(Zi) = 0, Var(2'i) = 1 

Consider the m.g.f., see that it is very similar to the standard normal distribution: 



Ee*7?r(^i+-+^'') = Ee*^i/^^ x ... x e*^"/^ = (Ee 



Therefore: 



Ee*^i = 1 + mZx + i^^EZi^ + if^EZ^ + ... 
= 1 + + Jt^EZ? + ... 



(Ee*^i/^)" « (1 + 



(1 + — )" n — » oo e* - m.g.f. of standard normal distribution! 

2n 



Gamma Distribution: 

Gamma function; for a > 0, /? > 
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r(a) = / x^-^e-'^dx 
Jo 

p.d.f of Gamma distribution, f(x): 

1= / x"-'e--dx,f{x) = {-—x"-'e--,x>0;0,x<0} 

Jo r(a) r(a) 

Change of variable x = (3y, to stretch the function: 



OO -1 POO rta 

Jo r(a) Jo T[a) 



p.d.f. of Gamma distribution, f{x\a,(3): 



f{x\a, P) = {f^2;"-ie-^^, a; > 0; 0, a; < 0} - Gamma{a, (3) 



1" 

rO 

Properties of the Gamma Function: 

pOO pOO 

T{a) = / s^-^e-^rfx = / a;«-id(-e-^) = 
Jo Jo 

Integrate by parts: 

poo poo 

= a;"-^e-^|g° - / (-e-^)(a - l)x''-^dx = + (a - 1) / x^-^e'^'dx ={a- l)T{a - 1) 
Jo Jo 

In summary, Property 1: T{a) = {a — l)r(a — 1) 
You can expand Property 1 as follows: 

r(n) = (n - l)r(n - 1) = (n - l)(n - 2)r(n - 2) = (n - l)(n - 2){n - 3)r(n - 3) = 



= (n - l)...(l)r(l) = (n - l)!r(l), r(l) = / e-^rfx = 1 ^ r(n) = (n - 1)! 

io 

In summary. Property 2: r(n) = (n — 1)! 
Moments of the Gamma Distribution: 

pco na oa poo 

EX''= ,x-^-^,E"-ie-^^rfa;= / x^^+'^^-^e'^'^dx 
Jo r(Q) r(a) Jo 

Make this integral into a density to simplify: 

roo Qa+k 

j.(a+fe)-ie-/3^rfa; 



r(a + fc) p 



r(a) 7o r(a + A;)' 

The integral is just the Gamma distribution with parameters {a + k,0)\ 

_ T{a + k) _ {a + k- l)(a + k - 2) x ... x ar{a) _ {a + k - 1) x ... x a 

For k = 1: 
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For k = 2: 



Example: 



E{X) 



a 



Var(a;) 



/32 

(a + l)a o? a 

^2 




If the mean = 50 and variance = 1 are given for a Gamma distribution, 
Solve for a = 2500 and /3 = 50 to characterize the distribution. 

Beta Distribution: 

Beta distribution p.d.f. - /(a;|a,/3) 
Proof: 

/•OO /'OO /"OO /"OO 

r(a)r(/3) = / a;"-ie-^da: / y^-^e'^dy = / j;"-i/-ie-(^+'')da;dy 
Jo Jo Jo Jo 

Set up for change of variables: 

^a-iy/3-ig-(x+y) ^ + _ a;)/3-ie-(^+f' = x'^'^x + yf'Ul —f-^e-^''+y^ 

x + y 

Change of Variables: 



s = X + y,t = ,x = st,y = s(l — t) Jacobian = s(l — t) — (—st) = s 

x + y 



Substitute: 



Jo Jo Jo Jo 



'ds 



= e-\i-tf-'^ xr{a + 13) = r{a)r{f3) 

Jo 



Moments of Beta Distribution: 
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Once again, the integral is the density function for a beta distribution. 

_ T{a + (3) r(a + fc)r(/3) _ r(a + /?) T{a + k) _ {a + k - 1) x ... x a 

~ T{a)T{p) ^ T{a + p + k) ~ T{a + I3 + k) T{a) ~ {a + (3 + k - I) x ... x {a + (3) 

For k = 1: 



For k = 2: 



2 ^ {a + l)a 

(a + /3+l)(a + /3) 



Var(X) = 




Shape of beta distribution. 



End of Lecture 22 
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